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Software-Intensive  System  Development 


Hits 

Misses 

•  Tomahawk  Missile 

•  Future  Combat  System 

•  Aegis 

•  B1  Bomber 

•  Link  16 

•  P8  Poseidon  MMA 

•  F-22  Raptor 

•  F-35  Joint  Strike  Fighter 
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The  Problem 


•  The  Defense  Acquisition  System  produces 
both  successful  and  challenged  software¬ 
intensive  systems 


The  Symptoms 


•  Development  cost  &  schedule  hyperinflation 

•  Systems  fielded  with  less  capability  than  desired 

•  Operational  capability  delayed  years 

•  Costly  and  difficult  software  sustainment 
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The  Underlying  Causes 


•  The  DoD  Requirements  Generation  System 

-  Requires  interpretation  between  Capabilities-Based 
terms  (JCIDS)  and  Performance-Based  terms 
(Performance  Spec),  and  again  to  Detailed  Specification 

-  Purposely  vague  to  gamer  maximum  innovation 

-  Dependent  on  the  developer  to  correctly  interpret 
and  propose  innovative  solutions 


-  Provides  only  a  glimpse  at  the  operational 
environment  through  the  Operational  Mode 
Summary/Mission  Profile 

-  Information  Assurance/Cyber  Security  needs 
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Causes  Continued 


•  Immature  Software  Engineering  Environment 

-  No  industry-wide  standards,  protocols,  formats, 
architectures,  tools,  or  languages 

-  No  sustainability  standards  or  architectures 

-  Very  limited  capability  for  reuse 


-  Totally  dependent  on  clear,  unambiguous,  and 
complete  requirements  (Half  or  more  of  the  software 
development  effort  occurs  before  PDR) 

-  Requirements  creep  and  late  definition  disastrous  to  the 
effort 
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Causes  Continued 


•  The  Defense  Acquisition  System 


-  Pressure  to  reduce  cycle  time  can  impact  front-end 
processes  (‘Get  RFP  on  the  street!’) 

-  No  consistent  methodologies  for  driving  software 
architecture  or  sustainability  design 

-  Information  Assurance/Cyber  Security  needs  drives 
developers  to  typically  build  software  from  scratch 


-  Software  TRLs  ineffective  at  reducing  development  risk 

-  Contractor  is  assessed  for  risk  (CMMI),  but  PM  team  has 
no  ‘maturity’  requirements 
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Attacking  the  Causes 


•  Implementation  of  analyses,  tools,  and  processes 


-  SEI’s  Quality  Attribute  Workshop  (QAW) 

•  A  more  complete  inventory  of  requirements 

-  MUIRS  Analysis 

•  Analyses  for  sustainability  and  safety/security  needs 


-  SEI’s  Architectural  Trade-off  Analysis  Methodology sm 


•  Clarifies  context  and  drives  architectural  design 

•  Connects  user  needs  to  system  design  to  test  program 

-  FMECA 


•  Identifies  critical  and  non-critical  system  attributes 

-  SEI’s  Software  Acquisition  (SA)-CMM 

•  Assesses  the  Government’s  PM  team  maturity 


:\cquMioii  Research  Program:  Creating  Synergy  for  Informed  Change 


\aval  l3ci^i]ifaduaic  Scliool 
CA 


7 


User 

Need 

QAW 

CDD 


Scenario  Development 


Use  Cases 
-Performance 
-  MUIRS - 


Growth  Scenarios 

-Performance 
-MUIRS  - 


Exploratory  Scenarios 

-Performance  — ^ 
-FMECA - 


-MUIRS 
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Test  Case  Development 


> 


Integrated 
Into  test 
program 


M^nk-nry.  CA 


QAW  &  ATAM  Integration  into  SW  Lifecycle  Management 


Mgt  QAW  ATAM  Build,  Test,  &  Operations  & 

Production  Mgt  Support  Mgt 

Requirements  Design  Metrics 

Elicitation  Development  Metrics 


ICD 

User 

Needs 


Explicit, 
Derived  & 
Implied 
Requirements 


CDD 

Scenario 
Development  & 


Prioritization 
Design  Reviews 
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Prototype 
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Tech 
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Source 
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System  & 

Software 
Design  & 
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Test  Case 
Development 
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Prototyping, 

Code,  Build, 
Integrate,  Test 
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&  Support 


SFR  PDR  CDR 


PCA 


Acquis  it  km  ResearcH  Program;  Creating  Synergy  fo.r  Informed  Change 


Naval  retailor jiJlljii:  .School 
Mtmlmv.  (  A 


SA-CMM 


Level 

Focus 

Key  Process  Areas 

5 

Optimizing 

Continuous  process  improvement,  Acquisition  Innovation 
Management,  Continuous  Process  Improvement 

4 

Quantitative 

Quantitative  management,  Quantitative  Acquisition 
Management,  Quantitative  Process  Management 

3 

Defined 

Process  standardization,  Training  Program  Management 
Acquisition  Risk  Management,  Contract  Performance 
Management,  Project  Performance  Management 

User  Requirements,  Process  Definition  and  Maintenance 

2 

Repeatable 

Basic  project  management,  Transition  to  Support 

Evaluation,  Contract  Tracking  and  Oversight,  Project 
Management,  Requirements  Development  and 

Management,  Solicitation,  Software  Acquisition  Planning 

1 

Initial 

Competent  people  and  heroics 
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Summary 


•  Using  these  tools,  analyses,  and  processes 
will  help  address  the  causes  of  software 
development  problems. 


•  The  PM  team  must  mature  beyond 
‘Competent  People  and  Heroics’  to  manage 
the  complex  software  development  challenge 


•  A  mature  PM  team  effectively  implementing 
the  tools,  analyses,  and  Processes  will  result 
in  more  consistently  successful  software¬ 
intensive  systems  development 
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